IMAGE PROCESSING APPARATUS 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to an image processing 

apparatus, and particularly to an image processing apparatus 
which is suitable for performing inter image calculations 
between two processed images of a single subject. 

Description of the Related Art 
10 Inspection of a single subject, by viewing two or more 

images thereof and investigating the differences among the 
images, is being performed in a variety of fields. 

For example, in the field of industrial manufacture, an 
image of a product immediately after manufacture and an image 
15 of the same product after durability tests have been 
administered thereon are comparatively viewed. By paying 
attention to parts where a large difference exists, parts of 
the product at which durability should be improved are 
investigated. In the field of medicine, a physician may 
20 comparatively view radiation images of a patient which have been 
taken at different times. Thereby, occurrence of new disease, 
a progression of disease, or a treatment state can be understood. 
Appropriate treatment protocols are investigated based on these 
understandings . 

25 In the case that two or more images, which are the objects 

of comparative viewing, are output, it is common for the images 
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to be simply arranged side by side. However, the differences 
among the images are the areas of greatest interest to a viewer. 
In the case that two images are simply arranged side by side 
as described above, it becomes difficult to find the differences 
5 as they get smaller. Therefore, there is demand for improved 
performance in comparative viewing of images . 

Therefore, extraction and emphasis of the differences 
between two images are being performed. This is accomplished 
by inter image calculation, including subtraction processes, 

10 in which positions of structural components (anatomically 
characteristic positions) in two images are made to correspond 
to each other (refer to, for example, U.S. Laid-open No. 
20010002934) . Particularly in the field of medicine, a 
temporal series subtraction technology has been proposed (refer 

15 to A. Kano, K. Doi, H. MacMahon, D. Hassell, M.L. Geiger ^^Digital 
Image Subtraction of Temporally Sequential Chest Images for 
Detection of Interval Change", Med. Phys . 21(3), March 19 94, 
453-461 [1]). This technology generates a difference image 
between radiation images taken in a temporal series. Aid in 

20 diagnosis by observing the generated difference image along 
with the radiation images taken in a temporal series is being 
attempted. 

A viewer of images is enabled to surely recognize the 
differences therebetween, by only the differences between 
25 images being extracted and emphasized in this manner. 
Therefore, for example, in the field of medicine, it can be 
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thought that progression or a treatment state of a diseased 
portion being overlooking will be prevented. 

It is desirable that the positions of structural 
components within images are positionally aligned so that they 
5 correspond between images which are to become objects of 
comparative viewing. This is because the positions of the 
structural components differ between images, due to changes in 
the posture of a subject, a difference in an imaging apparatus, 
and the like. As an example of this positional alignment, a 

10 two step process is known (refer to Japanese Unexamined Patent 
Publication No. 8 ( 1996) -335721 ) . The two step process 
involves a first positional alignment operation and a second 
positional alignment operation. The first positional 
alignment operation is a global transform (for example, Affine 

15 Transform) accomplished by parallel movement, rotation, 
magnification and reduction of the two images. The second 
positional alignment operation first divides the images into 
a plurality of local regions following the first positional 
alignment operation. Then, the images which have been matched 

20 in the corresponding local regions are subjected to nonlinear 
distortion transform (warping) by curve fitting (for example, 
a two dimensional tenth degree polynomial) . 

However, even if the structural components of two images 
are completely positionally aligned by the process disclosed 

25 in Japanese Unexamined Patent Publication No. 8 (1996) -335721, 
there are cases in which specific signal values representing 
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the density or the Ixminance of each correspondent structural 
component in the two images do not match. In these cases, 
artifacts due to the differences in signal values are generated 
in an inter image calculation image (difference image) obtained 
5 by inter image calculation. 

Images which are the objects of comparative viewing, that 
is, which are subject to inter image calculation, are not 
originally obtained with inter image calculation as an 
objective. Image processes according to image processing 

10 conditions appropriate for each image are administered thereon, 
so that each image per se is reproducible as a visible image 
suitable for viewing. Particularly in the case of images 
obtained in a temporal series, they are obtained with the 
objective of grasping the state of a subject at the time of image 

15 obtainment. Therefore, image processeis are administered with 
image processing conditions which are set for the particular 
obtained image. Accordingly, it is often the case that images 
which are the objects of inter image calculation have undergone 
image processes with image processing conditions which are 

20 different from each other. In these cases, the possibility of 
artifact occurrence is extremely high, because the signal 
values representing the density or the luminance of each 
correspondent structural component in the two images do not 
match. 

25 When images are saved, fundamentally, an image to which 

image processes have been administered (processed image) and 
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the image prior to image processes having been administered 
thereon (unprocessed image) are saved. The aforementioned 
problem can be prevented by performing the inter image 
calculation employing the unprocessed images. 
5 Recently, however, various standards have been adopted 

for the transmission and reception of images. Particularly in 
the field of medicine, standards such as DICOM have become 
prevalent, and transmission and reception of images via 
networks and the like have become facilitated. Accompanying 

10 this development, images are being exchanged in a variety of 
formats and states. Images for which only processed images 
exist are also being exchanged, necessitating inter image 
calculation between a processed image and an unprocessed image, 
or between two processed images. 

15 SUMMARY OF THE INVENTION 

The present invention has been developed in view of the 
circumstances described above. It is the object of the present 
invention to provide an image processing apparatus that enables 
obtainment of an inter image calculation image (difference 

20 image) suitable for viewing from two images, regardless of 
whether the two images have undergone image processes. 

The first and second image processing apparatuses 
according to the present invention perform correction on images 
which are to be the objects of inter image calculation, in the 

25 case that the images have undergone image processes. The 
correction corrects the processed images to states equivalent 
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to their unprocessed states, or approximates their unprocessed 
states. Then, inter image calculation is performed employing 
unprocessed images or corrected images. 

The first image processing apparatus of the present 
5 invention is equipped with an inter image calculating means for 
performing inter image calculations to derive differences 
between two images of a single subject to obtain a difference 
image that represents the differences between the two images, 
wherein: 

10 process confirmation data representing whether an image 

has undergone image processes is attached to each of the two 
images, and image processing condition data representing image 
processing conditions are further attached to the images which 
have undergone image processes; the image processing apparatus 

15 further comprising: 

a judgment means for judging whether the two images have 
undergone image processes, based on the process confirmation 
data attached to each of the two images; and 

a correction means for correcting an image which has been 

20 judged to have undergone image processes, to correct the image 
to a state equivalent to its original state prior to the image 
processes, based on the image processing condition data 
attached thereto; wherein: 

the inter image calculation means performs the inter 

25 image calculation employing the corrected image, for the image 
which has been judged to have undergone image processes. 
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The second image processing apparatus of the present 
invention is equipped with an inter image calculating means for 
performing inter image calculations to derive differences 
between two images of a single subject to obtain a difference 
5 image that represents the differences between the two images, 
wherein: 

process confirmation data representing whether an image 
has undergone image processes is attached to each of the two 
images; the image processing apparatus further comprising: 

10 a judgment means for judging whether the two images have 

undergone image processes, based on the process confirmation 
data attached to each of the two images; and 

a correction means for correcting an image which has been 
judged to have undergone image processes, to cause the image 

15 to approximate its original state prior to the image processes, 
based on typical image processing conditions of image processes 
which have been administered to the image; wherein: 

the inter image calculation means performs the inter 
image calculation employing the corrected image, for the image 

20 which has been judged to have undergone image processes. 

The third and fourth image processing apparatuses 
according to the present invention perform correction on a 
difference image to be obtained by inter image calculation, in 
the case that images which are to be the objects of the inter 

25 image calculation include an image which has undergone image 
processes. The correction obtains a difference image 
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equivalent to or approximating that which would be obtained if 
the inter image calculation was performed employing the two 
images prior to the image processes. 

The third image processing apparatus of the present 
5 invention is equipped with an inter image calculating means for 
performing inter image calculations to derive differences 
between two images of a single subject to obtain a difference 
image that represents the differences between the two images, 
wherein: 

10 process confirmation data representing whether an image 

has undergone image processes is attached to each of the two 
images, and image processing condition data representing image 
processing conditions are further attached to the images which 
have undergone image processes/ the image processing apparatus 

15 further comprising: 

a judgment means for judging whether the two images have 
undergone image processes, based on the process confirmation 
data attached to each of the two images; and 

a correction means for correcting the difference image 

20 to be obtained by the inter image calculation in the case that 
at least one of the two images have undergone image processes, 
to obtain a difference image equivalent to that which would be 
obtained if the inter image calculation was performed employing 
the two images prior to the image processes, based on the image 

25 processing condition data attached thereto. 

The fourth image processing apparatus of the present 
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invention is equipped with an inter image calculating means for 
performing inter image calculations to derive differences 
between two images of a single subject to obtain a difference 
image that represents the differences between the two images, 
5 wherein: 

process confirmation data representing whether an image 
has undergone image processes is attached to each of the two 
images, and image processing condition data representing image 
processing conditions are further attached to the images which 

10 have undergone image processes; the image processing apparatus 
further comprising : 

a judgment means for judging whether the two images have 
undergone image proceisses, based on the process confirmation 
data attached to each of the two images; and 

15 a correction means for correcting the difference image 

to be obtained by the inter image calculation in the case that 
at least one of the two images are judged to have undergone image 
processes, to obtain a difference image approximating that 
which would be obtained if the inter image calculation was 

20 performed employing the. two images prior to the image processes, 
based on typical image processing conditions of the image 
processes administered to the at least one of the two images. 

Images obtained by ordinary digital cameras, radiation 
images obtained by Computed Radiography (CR) systems, 

25 tomographic images obtained by Computed Tomography (CT) 
apparatuses or Magnetic Resonance Imaging (MRI) apparatuses. 
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and the like maybe employed as the aforementioned images. Note 
that animals, plants, industrial products, geographic features, 
astronomical bodies, and landscapes may be employed as the 
subject of the image, in addition to the hiiman body, 
5 The process confirmation data and the image processing 

condition data can be written into a header portion of image 
data which represents an image, for example. A predetermined 
parameter having set numerical values may be employed as the 
process confirmation data. The numerical value can represent 

10 whether an image is a processed image. For example, if the 
numerical value of the parameter is 0, the image is an 
unprocessed image, and if the numerical value of the parameter 
is 1, the image is a processed image. Specific data that 
identifies the image processing conditions may be employed as 

15 the image processing condition data. Alternatively, another 
predetermined parameter having numerical values that represent 
a type of image processing condition, in the case that the image 
processing conditions are prepared in advance in a plurality 
of types, maybe employed as the image processing condition data. 

20 For example, if the image process is a gradation process, in 
the former case, a representative point on a gradation curve 
may be expressed in coordinates, to specify the gradation curve . 
In the latter case, a gradation curve may be specified by the 
numerical value of the parameter, which corresponds to a type 

25 of gradation curve. 

A subtraction process, wherein pixels of image data sets 
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each representing an image are made to correspond with each 
other, is preferably applied as the inter image calculation. 
In this case, the calculation may be simple subtraction or 
weighted subtraction, A difference image obtained by a 
5 subtraction process is commonly referred to as a subtraction 
image. Subtraction images include: energy subtraction images 
obtained based on (simple or weighted subtraction) of two 
original images having different energy distributions (a high 
voltage image ordinary radiation image, and a low voltage image) 

10 obtained by substantially simultaneous photography; temporal, 
series subtraction images obtained based on two original images 
obtained at different times; Digital Subtraction Angiography 
(DSA) images obtained by two original images of blood vessels 
obtained before and after injection of a contrast agent; and 

15 the like. 

Regarding the first image processing apparatus, a 
correction means may be employed which identifies the image 
processing conditions of an image, which has been judged to be 
a processed image, based on the image processing condition data, 

20 and administers image processes to reverse the effects of the 
image processes. Thereby, the processed image is corrected to 
a state equivalent to its original state. 

Regarding the second image processing apparatus, a 
correction means may be employed which assumes that a typical 

25 image process, which is commonly administered, has been 
administered on an image which has been judged to be a processed 
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image, and administers image processes to reverse the effects 
of the assumed image process. Thereby, the processed image is 
corrected to approximate its original state. 

Regarding the third image processing apparatus, a 
5 correction means may be employed which specifies the image 
processing conditions of the image processes administered on 
an image, based on the image processing condition data attached 
to an image which has been judged to be a processed image. An 
inter image calculation formula is set which enables 

10 cancellation of the effects of the image processes and 
performance of inter image calculation simultaneously. By 
performing inter image calculation according to the set inter 
image calculation formula, a difference image obtained by the 
inter image calculation is corrected to a difference image 

15 equivalent to that which would have been obtained had the inter 
image calculation been performed employing two unprocessed 
images. Note that the inter image calculation formula which 
is set in accordance with the specified image processing 
conditions may be derived either theoretically or empirically. 

20 Regarding the fourth image processing apparatus, a 

correction means may be employed which assumes that a typical 
image process, which is commonly administered, has been 
administered on an image which has been judged to be a processed 
image. An inter image calculation formula is set in advance 

25 which enables cancellation of the effects of the image processes 
and performance of inter image calculation simultaneously. By 
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performing inter image calculation according to the set inter 
image calculation formula, a difference image obtained by the 
inter image calculation is corrected to a difference image 
approximating that which would have been obtained had the inter 
5 image calculation been performed employing two unprocessed 
images . 

Regarding the first and second image processing 
apparatuses, the image processes may include a gradation 
process and a frequency process. 
10 Regarding the third and fourth image processing 

apparatuses, the image processes may include a gradation 
process . 

A gradation process is a process for adjusting the density 
and the contrast of an image. For example, a gradation curve 

15 (a curve representing correspondent relationships between 
original pixel values and pixel values after conversion) may 
be set so that density ranges of structural components of 
interest of a subject are assigned to main gradation levels. 
Then, pixel value conversion may be performed according to the 

2 0 gradation curve. 

A frequency process is a process for adjusting the density 
of a specific spatial frequency range of an image. For example, 
a process may be considered which increases the density of a 
high frequency range in order to heighten the sharpness of an 

25 image. As a specific method for realizing this process, pixel 
values of an original image may be averaged with a predetermined 
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mask size, to generate a so called unsharp image. A 
differential image between the unsharp image and the original 
image may be obtained, and the differential image added to the 
original image. 

5 It is desirable that the first through fourth image 

processing apparatuses further comprise: 

a positional alignment means for aligning the positions 
of the two images so that structural components of the single 
subject substantially match; wherein 

10 the inter image calculation means performs the inter 

image calculation between the two images which have been 
positionally aligned. Note that the positional alignment of 
the two images may be performed before the correction of the 
processed images. 

15 Regarding the first through fourth image processing 

apparatuses, the two images may be images obtained at different 
times, for comparative viewing with the passage of time. For 
example, current and past images of the same portion of a patient 
may be considered. 

20 According to the first image processing apparatus of the 

present invention, a judgment is made as to whether an image 
has undergone image processes, based on process confirmation 
data that represents whether the image is a processed image, 
which is attached to each of two images of a single subject. 

25 An image which has been judged to be a processed image is 
corrected to a state equivalent to its original state prior to 
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the image processes, based on image processing condition data 
that represents the image processing condition of the image 
processes administered thereon, which is attached to the image. 
Then, inter image calculation is performed between the two 
5 images to obtain a difference image. The two images are 
returned to their original states or equivalents thereof, prior 
to the inter image calculation. That is, density shift due to 
image processes is eliminated, and signal values that represent 
the density of correspondent structural components of a subject 

10 substantially match between the two images. Therefore, the 
occurrence of artifacts in a difference image obtained based 
on the two images, arising from differences in the 
aforementioned signal values, can be prevented. Difference 
images suitable for observation can be obtained regardless of 

15 whether the two images are processed images. 

There are cases in which inter image calculation is 
performed on two images of a single subject, to which image 
processes have been administered according to substantially 
identical image processing conditions. In these cases, 

20 artifacts due to differences in the signal values that represent 
correspondent structural components are suppressed. However, 
differences in a density range which has been compressed by 
image processes become difficult to discern in a difference 
image. The first image processing apparatus of the present 

25 invention corrects two images which are to be the objects of 
inter image calculation so that they are returned to their 



15 



original states prior to image processes or equivalents thereof, 
in which no density shift exists . Therefore, such difficulties 
in discernment of differences can also be prevented. 

According to the second image processing apparatus of the 
5 present invention, a judgment is made as to whether an image 
has undergone image processes, based on process confirmation 
data that represents whether the image is a processed image, 
which is attached to each of two images of a single subject. 
An image which has been judged to be a processed image is 

10 corrected to approximate its original state prior to the image 
processes, based on typical image processing conditions of 
image processes which are administered on the image. Then, 
inter image calculation is performed to obtain a difference 
image. Images which are known to be processed images but for 

15 which image processing conditions are unknown are enabled to 
be corrected to approximate their original states prior to the 
image processes, based on typical image processing conditions. 
Therefore, advantageous effects similar to those of the first 
image processing apparatus can be expected. 

20 According to the third image processing apparatus of the 

present invention, a judgment is made as to whether an image 
has undergone image processes, based on process confirmation 
data that represents whether the image is a processed image, 
which is attached to each of two images of a single subject. 

25 In the case that at least one of the two images is judged to 
be a processed image, the difference image is corrected, based 
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on image processing condition data that represents the image 
processing condition of the image processes administered to the 
image, which is attached to the processed image . The correction 
obtains a difference image equivalent to that which would be 
5 obtained if the inter image calculation was performed employing 
the two images prior to the image processes. That is, a 
difference image is obtained equivalent to that obtained if 
images are employed in which density shift due to image 
processes is eliminated, and signal values that represent the 

10 density of correspondent structural components of a subject 
substantially match between the two images. Therefore, the 
occurrence of artifacts in the difference image obtained based 
on the two images, arising from differences in the 
aforementioned signal values, can be prevented. Difference 

15 images suitable for observation can be obtained regardless of 
whether the two images are processed images . 

There are cases in which inter image calculation is 
performed on two images of a single subject, to which image 
processes have been administered according to substantially 

20 identical image processing conditions. In these cases, 
artifacts due to differences in the signal values that represent 
correspondent structural components are suppressed. However, 
differences in a density range which has been compressed by 
image processes become difficult to discern in a difference 

25 image. The third image processing apparatus of the present 
invention obtains a difference image based on two images which 
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are in their original states prior to image processes or 
equivalents thereof, in which no density shift exists. 
Therefore, such difficulties in discernment of differences can 
also be prevented, 
5 According to the fourth image processing apparatus of the 

present invention, a judgment is made as to whether an image 
has undergone image processes, based on process confirmation 
data that represents whether the image is a processed image, 
which is attached to each of two images of a single subject. 

10 In the case that at least one of the two images is judged to 
be a processed image, the difference image is corrected. The 
correction obtains a difference image approximating that which 
would be obtained if the inter image calculation was performed 
employing the two images prior to the image processes, based 

15 on typical image processing conditions of the image processes 
administered thereon. Even in the case that either or both of 
the two images is known to be processed images but the image 
processing conditions are unknown, the difference image is 
enabled to be corrected as described above. Therefore, 

20 advantageous effects similar to those of the first image 
processing apparatus can be expected. 

Note that the first through fourth image processing 
apparatuses may further comprise: a positional alignment means 
for aligning the positions of the two images so that structural 

25 components of the single subject substantially match; wherein 
the inter image calculation means performs the inter image 
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calculation between the two images which have been positionally 
aligned. In this case, artifacts caused by positional 
misalignment due to changes in the posture of a subject, a 
difference in an imaging apparatus and the like can be reduced. 
5 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram illustrating the construction 
of an image processing apparatus according to a first 
embodiment . 

Figure 2A and Figure 2B are graphs showing gradation 
10 curves employed in gradation processes. 

Figure 3A and Figure 33 show chest radiation images of 
a human body, to be input to the image processing apparatus. 

Figure 4 shows a chest radiation image which has been 
corrected to an image equivalent to that prior to image 
15 processes being administered thereon. 

Figure 5 shows a temporal series subtraction image. 
Figure 6 shows a flow chart of processes performed by an 
image processing apparatus according to a third embodiment. 

Figure 7 is a block diagram illustrating the construction 
20 of an image processing apparatus according to a fourth 
embodiment . 

Figure 8 is a graph showing different types of gradation 
curves employed in a gradation process. 

Figure 9A and Figure 9B show chest radiation images of 
25 a human body, to be input to the image processing apparatus. 

Figure 10 is a graph showing a gradation curve employed 
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in a gradation process. 

Figure 11 shows a temporal series subtraction image. 
Figure 12 shows a flow chart of processes performed by 
an image processing apparatus according to a sixth embodiment. 
5 BEST MODE FOR CARRYING OUT THE INVENTION 

Hereinafter, . embodiments of the image processing 
apparatus according to the present invention will be described. 
Figure 1 is a block diagram illustrating the construction of 
a first embodiment of the image processing apparatus 

10 (corresponding to the first image processing apparatus) 
according to the present invention. Note that in the present 
embodiment, two images which are the objects of inter image 
calculation are images of a single subject obtained at different 
times, for comparative viewing of changes over time. 

15 Specifically, the images are chest radiation images of which 
one is a current image obtained at present, and the other is 
a past image obtained in the past. A case will be assumed 
wherein the image processing apparatus 1 obtains a temporal 
series subtraction image that represents the differences 

20 between the two images. The temporal series subtraction image 
will be provided for observation and diagnosis of newly diseased 
portions. Process confirmation data Z that represents whether 
the image has undergone image processes is attached to each of 
the two images . Further, image processing condition data C that 

25 represents the image processing conditions of the image process 
which has been administered is attached to images which have 
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undergone image processes (processed images) . 

The image processing apparatus 1 shown in Figure 1 
comprises: a judgment means 10 for judging whether the current 
and past chest radiation images (hereinafter, referred to as 
5 ^^original images'') PI and P2 are processed images, based on the 
process confirmation data Zl and Z2 respectively attached 
thereto; a correction means 20 for correcting an original image 
Pi (i is a variable) which has been judged by the judgment means 
10 to be a processed image, to obtain a corrected image Pi' which 

10 is equivalent to the image prior to image processes being 
administered thereon (unprocessed image) , based on the image 
processing condition data Ci attached to the image Pi; a 
positional alignment means 30 for aligning the image PI (or PI' , 
corrected by the correction means 20, in the case that original 

15 image PI has been judged to be a processed image) and the image 
P2 (or P2', corrected by the correction means 20, in the case 
that original image P2 has been judged to be a processed image) 
so that structural components of the subject therein 
substantially match; and an inter image calculation means 4 0 

20 for performing inter image calculation (a subtraction process 
in the present embodiment) between the image PI (or PI' 
corrected by the correction means 20, in the case that original 
image PI has been judged to be a processed image) and the image 
P2 (or P2' , in the case that original image P2 has been judged 

25 to be a processed image) , which have been positionally aligned 
by the positional alignment means 30, to obtain a difference 
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image PS (a temporal series subtraction image in the present 
embodiment) that represents the differences between the image 
PI (or PI') and the image P2 (or P2' ) • 

The original images PI and P2 are chest radiation images 
5 of a human body represented based on digital image data. The 
digital image data is read out from stimulable phosphor sheets, 
on which radiation images are recorded. The stimulable 
phosphor sheet is a radiation detection panel comprising a 
stimulable phosphor layer. Stimulable phosphors record the 

10 energy of radiation irradiated thereon, and emit stimulated 
phosphorescence corresponding to the amount of radiation energy 
recorded therein when irradiated with excitation light later. 
The radiation images are recorded by irradiating radiation onto 
the chest of a human subject, and recording the radiation which 

15 has passed therethrough in the stimulable phosphor sheet. The 
images PI and P2 are a current image obtained at present, and 
a past image obtained in the past. The images PI and P2 are 
either unprocessed images to which image processes have not yet 
been administered, or processed images to which image processes 

20 have been administered. Note that the referents of ^^image 
processes" are data conversion processes administered to 
standardized images, according to image processing conditions 
distinctly set for the purpose of observation or for regions 
of interest within the subject image. The image processes" 

25 do not include processes for adjusting the gradation of an image 
obtained by an imaging apparatus, which varies according to 
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imaging conditions, to standardize the gradation thereof. 

In the present embodiment, the image processes include 
a gradation process and a frequency process. 

The gradation process converts pixel values according to 
5 gradation curves such as those shown in Figure 2A. The 
gradation curves represent correspondent relationships 
between pixel values before and after the gradation process. 
Note that several types of gradation curves are prepared in 
advance . 

10 The frequency process is performed based on an emphasis 

process, called an USM process, according to a formula such as 
Formula (1) below. An unsharp image Pu is generated by 
averaging the pixel values of an original image Po with a 
predetermined mask size. The unsharp image Pu is subtracted 

15 from the original image Po, and the difference is multiplied 
by coefficient p (P>0) . The product of the multiplication is 
added to the original image Po, to obtain an image Po' , in which 
the edges are emphasized. 

20 Po' = Po + (3 X (Po - Pu) (1) 

Process confirmation data Z and image processing 
condition data C are attached to the original image PI and P2 
as header information. Specifically, a parameter Z, which 
25 represents whether the image has been processed or not 
respectively with values of 0 and 1, is attached as the process 
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confirmation data Z . A parameter G representing the type number 
of the gradation curve employed in the gradation process; and 
a mask size R and a coefficient (3 employed in the frequency 
process are attached as the image processing condition data C. 
5 The operation of the image processing apparatus 1 of the 

present embodiment will be described. 

First, original images PI and P2, which are chest 
radiation images as shown in Figure 3A and Figure 3B, are input 
to the image processing apparatus !• The judgment means 10 

10 reads out parameters Zl and Z2, which are respectively attached 
to the images PI and P2 as process confirmation data . A judgment 
is made regarding whether the images are processed images, based 
on the values of the parameters Zl and Z2 (for example, a value 
of 0 represents an unprocessed image, and a value of 1 represents 

15 a processed image) . Note that here, it is assumed that the image 
PI is an unprocessed current image obtained at present, and that 
the image P2 is a processed image obtained in the past, to which 
image processes have been administered. In addition, the image 
PI represents a chest having a diseased portion K therein. 

20 The correction means 20 first reads out the parameter G2 

from the header information of the original image P2, which has 
been judged to be a processed image by the judgment means 10. 
The type of gradation curve which was employed in the gradation 
process is determined from the parameter G2 . The correction 

25 means 20 administers a reverse gradation process on the image 
P2, by employing a gradation curve having input/output values 
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opposite that of the gradation curve specified by parameter G2 . 
It is assumed that three types of gradation curves, denoted as 
Type If Type 2, and Type 3 in Figure 2A, are prepared in advance. 
The value of the parameter G2 specifies the type of gradation 
5 curve which was employed in the gradation process. Here, it 
is assumed that parameter G2=2, that is, that the Type 2 
gradation curve was employed. The reverse gradation process 
is administered on the image P2 employing a gradation curve 
denoted as Type 2' in Figure 2B, which as input/output values 

10 opposite that of the Type 2 gradation curve. 

Then, the correction means 20 reads out the mask size R2 
and the coefficient (32 from the header information of the 
original image P2 . A reverse frequency process is administered 
on the image P2 according to Formula (1)' shown below. An 

15 unsharp image P2u is generated by averaging the pixels values 
of the original image P2 with a mask size of R2 . The unsharp 
image P2u is subtracted from the original image P2, and the 
difference is multiplied by the coefficient |32 ((32>0) • The 
product of the multiplication is subtracted from the original 

20 image P2, to obtain an image P2' , in which the edges are blurred. 
In this manner, the original image P2 is corrected to the image 
P2' , which approximates the image P2 before image processes were 
administered thereon. 

25 P2' = P2 - p2 X (P2 - P2u) (1)' 
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Figure 4 shows the image P2' which has been obtained in this 
manner . 

The positional alignment means 30 employs known 
techniques such as affine transform and nonlinear distortion 
5 transform (warping) so that one of the images PI andP2' is caused 
to match the other. Here, the image P2' is transformed to obtain 
an image P2'w, which matches the image PI. 

The inter image calculation means 40 performs a 
subtraction process between the images PI and P2'w according 
10 to Formula (2) shown below, to obtain a temporal series 
subtraction image PS. 

PS = cont X (PI - P2'w) + mid (2) 
wherein ^^cont" represents a contrast coefficient and ^^mid" 
15 represents a middle value. 

Figure 5 shows the temporal series subtraction image PS 
obtained in this manner. An observer is enabled to find the 
newly developed diseased portion K easily by viewing the 
. temporal series subtraction image PS. 
20 According to the image processing apparatus 1 according 

to the first embodiment of the present invention, a judgment 
is made as to whether an image has undergone image processes, 
based on process confirmation data that represents whether the 
image is a processed image, which is attached to each of two 
25 images of a single subject. An image which has been judged to 
be a processed image is corrected to a state equivalent to its 
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original state prior to the image processes, based on image 
processing condition data that represents the image processing 
condition of the image processes administered thereon, which 
is attached to the image. Then, inter image calculation is 
5 performed between the two images to obtain a difference image. 
The two images are returned to their original states or 
equivalents thereof, prior to the inter image calculation. 
That is, density shift due to image processes is eliminated, 
and signal values that represent the density of correspondent 

10 structural components of a subject substantially match between 
the two images. Therefore, the occurrence of artifacts in a 
difference image obtained based on the two images, arising from 
differences in the aforementioned signal values, can be 
prevented. Difference images suitable for observation can be 

15 obtained regardless of whether the two images are processed 
images . 

There are cases in which inter image calculation is 
performed on two images of a single subject, to which image 
processes have been administered according to substantially 

20 identical image processing conditions. In these cases, 
artifacts due to differences in the signal values that represent 
correspondent structural components are suppressed. However, 
differences in a density range which has been compressed by 
image processes become difficult to discern in a difference 

25 image. The image processing apparatus 1 according to the first 
embodiment corrects two images which are to be the objects of 
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inter image calculation so that they are returned to their 
original states prior to image processes or equivalents thereof, 
in which no density shift exists . Therefore, such difficulties 
in discernment of differences can also be prevented, 
5 A second embodiment of the image processing apparatus 

according to the present invention (corresponding to the second 
image processing apparatus) , based on the first embodiment, 
will now be described. In the second embodiment, original 
images PI and P2 to be input have at least process confirmation 

10 data Z attached thereto (regardless of whether image processing 
condition data C are attached) . A correction means 2 0 corrects 
images which have been judged to be processed images by a 
judgment means 10, based on typical image processing conditions 
of image processes administered to the images. That is, the 

15 correction means 20 administers image processes having image 
processing conditions opposite the typical image processing 
conditions on the images. A corrected image approximating an 
unprocessed image is obtained thereby. In this case, a judgment 
is made as to whether an image has undergone image processes, 

20 based on process confirmation data that represents whether the 
image is a processed image, which is attached to each of two 
images of a single subject. An image which has been judged to 
be a processed image is corrected to approximate its original 
state prior to the image processes, based on typical image 

25 processing conditions of image processes which are administered 
on the image. Then, inter image calculation is performed to 
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obtain a difference image • Images which are known to be 
processed images but for which image processing conditions are 
unknown are enabled to be corrected to approximate their 
original states prior to the image processes, based on typical 
5 image processing conditions . Therefore, advantageous effects 
similar to those of the image processing apparatus 1 according 
to the first embodiment can be expected. 

A third embodiment of the image processing apparatus 
according to the present invention (corresponding to a 

10 combination of the first and second image processing 
apparatuses) , based on the first embodiment, will now be 
described. In the third embodiment, original images PI and P2 
to be input have at least process confirmation data Z attached 
thereto (regardless of whether image processing condition data 

15 C are attached) . A correction means 20 corrects an image which 
has been judged to be processed images by a judgment means 10, 
based on image processing condition data C, in the case that 
the image processing condition data C is attached to the image. 
That is, the correction means 20 administers image processes 

20 on the image opposite to that which has been administered 
previously, to correct the image to a state equivalent to that 
of an unprocessed image. In the case that the image processing 
condition data C is not attached to the image, the correction 
means 20 corrects the image based on typical image processing 

25 conditions of image processes administered to the images. That 
is, the correction means 20 administers image processes having 
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image processing conditions opposite the typical image 
processing conditions on the images, A corrected image 
approximating an unprocessed image is obtained thereby. 
Specifically^ the image processing apparatus of the third 
5 embodiment performs processes according to a process flow such 
as that shown in Figure 6, 

First, a parameter Zl is readout from header information 
of the input original image PI, to judge whether it is a processed 
image (Step SI) . In the case that the image PI is not a processed 

10 image, the process proceeds to processes regarding the image 
P2 . In the case that the image PI is a processed image, whether 
a parameter Gl, which specifies a gradation curve employed in 
a gradation process, is included in the header information is 
judged (Step 32) . In the case that the parameter Gl is included, 

15 the parameter Gl is read out from the header information to 
specify the type of gradation curve employed in the gradation 
process. Then, a reverse gradation process is administered on 
the image PI, according to a gradation curve having input/output 
values opposite that of the specified gradation curve (Step S3) . 

20 In the case that the parameter Gl is not included, a reverse 
gradation process is administered on the image PI, according 
to a gradation curve having input/output values opposite that 
of a typical gradation curve which is employed in a gradation 
process administered on the image PI (for example, a gradation 

25 curve most commonly used for a type of subject) (StepS4) . Then, 
whether a mask size Rl and a coefficient (31, employed in a 
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frequency process^ are included in the header information is 
judged (Step S5) . In the case that the mask size Rl and the 
coefficient (Jl are included, Rl and 31 are read out from the 
header information. Then, a reverse frequency process is 
5 administered on the original image PI according to Formula (1) " 
shown below (Step S6) . In the reverse frequency process, an 
unsharp image Plu is generated by averaging the pixels values 
of the original image PI with a mask size of Rl . The unsharp 
image Plu is subtracted from the original image PI, and the 
10 difference is multiplied by the coefficient (51 (31>0) . The 
product of the multiplication is subtracted from the original 
image PI to obtain an image PI' , in which the edges are blurred. 

PI' = PI - pi X (PI - Plu) (1)" 

15 

In the case that the mask size Rl and the coefficient pi are 
not included, Rl and pi are set based on a typical frequency 
process which is administered on the image PI, and a reverse 
frequency process is administered according to Formula (1)" 

20 (Step S7) . 

Thereafter, processes similar to steps SI through S7 are 
performed with respect to the original image P2 . In the case 
that the image P2 is a processed image, correction is performed 
to correct the image P2 to a state equivalent to or approximating 

25 an unprocessed image (Step S8) . Then, the image PI (or 
corrected image PI' ) and the image P2 (or corrected image P2' ) 
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are positionally aligned (Step S9) . Finally, inter image 
calculation is performed between the images PI and P2, which 
have been corrected to states as close as possible to their 
unprocessed states (Step SIO) . 
5 The first, second and third embodiments described above 

are equipped with the positional alignment means 30 for aligning 
the positions of the two images so that structural components 
of the single subject substantially match. Therefore, 
artifacts caused by positional misalignment due to changes in 

10 the posture of a subject, a difference in an imaging apparatus 
and the like can be reduced in the difference image obtained 
by the inter image calculation means 40. Accordingly, a 
difference image can be obtained which is more suitable for 
observation. Note that the positional alignment means 30 is 

15 not strictly necessary in the image processing apparatus 1. 
There are cases in which the two images which are the objects 
of inter image calculation are in a state such that 
substantially no positional misalignment exists therebetween. 
In these cases, a difference image suitable for effective 

20 observation can be obtained without performing positional 
alignment . 

Note that the process confirmation data Z may be provided 
separately from the image processing condition data C, as in 
the above embodiments. Alternatively, the image processing 
25 condition data C may also serve as the process confirmation data 
Z. A value of, for example, 0, for a parameter which specifies 



image processing conditions may represent that the image is an 
unprocessed image. 

Regarding the third embodiment, the process confirmation 
data Z may be provided for each type of image process* In this 
5 case, a judgment is made regarding whether image processes have 
been administered for each type of image process. Whether to 
perform correction may be determined for each type of image 
process, based on the result of the judgment. 

Note that a frequency process is a process for adjusting 

10 the density of a portion of the image, such as an outline of. 
a subject. Therefore, the chances of mismatched density values 
between images due to a frequency process contributing to 
artifacts in a difference image is small when compared to a 
gradation process. Accordingly, sufficiently effective 

15 correction may be performed by correcting only for a gradation 
process, in the case that both a gradation process and a 
frequency process have been administered. 

Alternate embodiments of the image processing apparatus 
according to the present invention will be described. Figure 

20 7 is a block diagram illustrating the construction of a fourth 
embodiment of the image processing apparatus (corresponding to 
the third image processing apparatus) according to the present 
invention. Note that in the present embodiment, two images 
which are the objects of inter image calculation are images of 

25 a single subject obtained at different times, for comparative 
viewing of changes over time. Specifically, the images are 
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chest radiation images of which one is a current image obtained 
at present, and the other is a past image obtained in the past. 
A case will be assumed wherein the image processing apparatus 
2 obtains a temporal series subtraction image that represents 
5 the differences between the two images. The temporal series 
subtraction image will be provided for observation and 
diagnosis of newly diseased portions. Process confirmation 
data Z that represents whether the image has undergone image 
processes is attached to each of the two images. Further, image 

10 processing condition data C that represents the image 
processing conditions of the image process which has been 
administered is attached to images which have undergone image 
processes (processed images) . 

The image processing apparatus 2 shown in Figure 7 

15 comprises: a judgment means 110 for judging whether the current 
and past chest radiation images (hereinafter, referred to as 
^^original images") PI and P2 are processed images, based on the 
process confirmation data Zl and Z2 respectively attached 
thereto; a positional alignment means 120 for aligning the image 

20 PI and the image P2 so that structural components of the subject 
therein substantially match; a formula setting means 130 for 
setting an inter image calculation formula which enables 
cancellation of the effects of the image processes on images 
which have been judged to be processed images by the judgment 

25 means 110, based on the image processing condition data Ci (i 
is a variable) attached thereto, and inter image calculation 
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(a subtraction process in the present embodiment) 
simultaneously; and performance of an inter image calculation 
means 140 for performing inter image calculation between the 
image PI and the image P2, which have been positionally aligned 
5 by the positional alignment means 120, according to the inter 
image calculation formula set by the formula setting means 130, 
to obtain a difference image PS (a temporal series subtraction 
image in the present embodiment) equivalent to that which would 
be obtained if the inter image calculation was performed between 
10 the images PI and P2 prior to image processes being administered 
thereon . 

The original images PI and P2 are chest radiation images 
of a human body represented based on -digital image data. The 
digital image data is read out from stimulable phosphor sheets, 

15 on which radiation images are recorded. The stimulable 
phosphor sheet is a radiation detection panel comprising a 
stimulable phosphor layer. Stimulable phosphors record the 
energy of radiation irradiated thereon, and emit stimulated 
phosphorescence corresponding to the amount of radiation energy 

20 recorded therein when irradiated with excitation light later. 
The radiation images are recorded by irradiating radiation onto 
the chest of a human subject, and recording the radiation which 
has passed therethrough in the stimulable phosphor sheet. The 
images PI and P2 are a current image obtained at present, and 

25 a past image obtained in the past. The images PI and P2 are 
either unprocessed images to which image processes have not yet 



been administered, or processed images to which image processes 
have been administered. Note that the referents of image 
processes" are data conversion processes administered to 
standardized images, according to image processing conditions 
5 distinctly set for the purpose of observation or for regions 
of interest within the subject image. The image processes" 
do not include processes for adjusting the gradation of an image 
obtained by an imaging apparatus, which varies according to 
imaging conditions, to standardize the gradation thereof. 

10 In the present embodiment, the image process is a 

gradation process. 

The gradation process converts pixel values according to 
gradation curves such as those shown in Figure 8 . The gradation 
curves represent correspondent relationships between pixel 

15 values before and after the gradation process. Note that 
several types of gradation curves are prepared in advance. 

Process confirmation data Z and image processing 
condition data C are attached to the original image PI and P2 
as header information. Specifically, a parameter Z, which 

20 represents whether the image has been processed or not 
respectively with values of 0 and 1, is attached as the process 
confirmation data Z. A parameter G representing the type number 
of the gradation curve employed in the gradation process is 
attached as the image processing condition data C. 

25 The operation of the image processing apparatus 2 of the 

present embodiment will be described. 
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First, original images PI and P2, which are chest 
radiation images as shown in Figure 9A and Figure 9B, are input 
to the image processing apparatus !• The judgment means 110 
reads out parameters Zl and Z2, which are respectively attached 
5 to the images PI and P2 as process confirmation data. A judgment 
is made regarding whether the images are processed images, based 
on the values of the parameters Zl and Z2 (for example, a value 
of 0 represents an unprocessed image, and a value of 1 represents 
a processed image) . Note that here, it is assumed that the image 

10 PI is an unprocessed current image obtained at present, and that 
the image P2 is a processed image obtained in the past, to which 
image processes have been administered. In addition, the image 
PI represents a chest having a diseased portion K therein. 

The positional alignment means 120 employs known 

15 techniques such as affine transform and nonlinear distortion 
transform (warping) so that one of the images PI and P2 is caused 
to match the other. Here, the image P2 is transformed to obtain 
an image P2w, which matches the image PI . 

The formula setting means 130 reads out parameter G2 from 

20 the header information of the original image P2, which has been 
judged to be a processed image by the judgment means 110. The 
type of gradation curve which was employed in the gradation 
process is determined from the parameter G2 . The formula 
setting means 130 sets an inter image calculation formula that 

25 enables cancellation of the gradation process which employed 
the determined gradation curve and performance of inter image 
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calculation, simultaneously. The inter image calculation 
(subtraction process) is performed according to a formula such 
as that shown as Formula (3) below, to obtain a temporal series 
subtraction image PS. 

PS = cont X (a X PI - b X P2w) + mid (3) 
wherein ^^cont" represents a contrast coefficient, ^^a'' and ^^b". 
represent coefficients, and ^""mid" represents a middle value. 

In an ordinary subtraction process, calculation is 
performed with the coefficients a and b both equal to 1 . However, 
a gradation process has been administered on the image P2 
employing a gradation curve such as that shown in Figure 10. 
A function representing this gradation curve is expressed as 
d'=f(d). An inter image calculation formula is with: cont = 
a desired value, a = 1, and b = f"^ is set, to yield Formula 
(3)' shown below. 

PS = cont X (PI - f"^(P2w)) + mid (3)' 

The inter image calculation means 140 performs inter 
image calculation according to Formula (3)', and obtains a 
temporal series subtraction image PS. The temporal series 
subtraction image PS is equivalent to a difference image which 
would have been obtained had ordinary inter image calculation 
been performed employing the original images PI and P2 prior 
to image processes being administered thereon. 
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Figure 11 shows the temporal series subtraction image PS 
obtained in this manner. An observer is enabled to find the 
newly developed diseased portion K easily by viewing the 
.temporal series subtraction image PS, 
5 According to the image processing apparatus 2 according 

to the fourth embodiment, a judgment is made as to whether an 
image has undergone image processes, based on process 
confirmation data that represents whether the image is a 
processed image, which is attached to each of two images of a 

10 single subject. In the case that at least one of the two images 
is judged to be a processed image, the difference image is 
corrected based on image processing condition data that 
represents the image processing condition of the image 
processes administered to the image, which is attached to the 

15 processed image. The correction obtains a difference image 
equivalent to that which would be obtained if the inter image 
calculation was performed employing the two images prior to the 
image processes. That is, a difference image is obtained 
equivalent to that obtained if images are employed in which 

20 density shift due to image processes is eliminated, and signal 
values that represent the density of correspondent structural 
components of a subject substantially match between the two 
images. Therefore, the occurrence of artifacts in the 
difference image obtained based on the two images, arising from 

25 differences in the aforementioned signal values, can be 
prevented. Difference images suitable for observation can be 
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obtained regardless of whether the two images are processed 
images . 

There are cases in which inter image calculation is 
performed on two images of a single subject, to which image 
5 processes have been administered according to substantially 
identical image processing conditions. In these cases, 
artifacts due to differences in the signal values that represent 
correspondent structural components are suppressed. However, 
differences in a density range which has been compressed by 

10 image processes become difficult to discern in a difference 
image. The third image processing apparatus of the present 
invention obtains a difference image based on two images which 
are in their original states prior to image processes or 
equivalents thereof, in which no density shift exists. 

15 Therefore, such difficulties in discernment of differences can 
also be prevented. 

A fifth embodiment of the image processing apparatus 
according to the present invention (corresponding to the fourth 
image processing apparatus) , based on the fourth embodiment, 

20 will now be described. In the fifth embodiment, original images 
PI and P2 to be input have at least process confirmation data 
Z attached thereto (regardless of whether image processing 
condition data C are attached) . A formula setting means 130 
assumes that a typical image process, which is commonly 

25 administered, has been administered on an image which has been 
judged to be a processed image by a judgment means 110. The 



formula setting means 130 sets an inter image calculation 
formula which enables cancellation of the effects of the image 
processes and performance of inter image calculation 
simultaneously. In this case, a judgment is made as to whether 
5 an image has undergone image processes, based on process 
confirmation data that represents whether the image is a 
processed image, which is attached to each of two images of a 
single subject. In the case that at least one of the two images 
is judged to be a processed image, the difference image is 

10 corrected, based on typical image processing conditions of the 
image processes administered on the image. The correction 
obtains a difference image approximating that which would be 
obtained if the inter image calculation was performed employing 
the two images prior to the image processes. Even in the case 

15 that either or both of the two images is known to be processed 
images but the image processing conditions are unknown, the 
difference image is enabled to be corrected as described above. 
Therefore, advantageous effects similar to those of the first 
image processing apparatus can be expected. 

20 A sixth embodiment of the image processing apparatus 

according to the present invention (corresponding to a 
combination of the third and fourth image processing 
apparatuses) , based on the fourth embodiment, will now be 
described. In the sixth embodiment, original images PI and P2 

25 to be input have at least process confirmation data Z attached 
thereto (regardless of whether image processing condition data 
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C are attached) . A formula setting means 130 sets an inter image 
calculation formula that enables cancellation of the effects 
of image processes administered on images, which have been 
judged to be processed images by a judgment means 110, and 
5 performance of inter image calculation simultaneously. The 
inter image calculation formula is set based on image processing 
condition data C, in the case that the image processing 
condition data C is attached to the processed image. The inter 
image calculation formula is set based on typical image 

10 processing conditions of image processes administered to the 
processed image, in the case that the image processing condition 
data C is not attached to the processed image. The inter image 
calculation means performs inter image calculation according 
to the set inter image calculation formula, to obtain a 

15 difference image which is as close as possible to a difference 
image which would be obtained if the inter image calculation 
was performed with the images before image processes were 
administered thereon. Specifically, the image processing 
apparatus of the sixth embodiment performs processes according 

20 to a process flow such as that shown in Figure 12. 

First, a parameter Zl is read out from header information 
of the input original image PI, to judge whether it is a processed 
image (Step Sll) . In the case that the image PI is not a 
processed image, the process proceeds to processes regarding 

25 the image P2 , In the case that the image PI is a processed image, 
whether a parameter Gl, which specifies a gradation curve 
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employed in a gradation process, is included in the header 
information is judged (Step S12) . In the case that the 
parameter Gl is included, the parameter Gl is read out from the 
header information to specify the type of gradation curve 
5 employed in the gradation process (Step S13) . In the case that 
the parameter Gl is not included, it is assumed that a gradation 
process has been administered employing a typical gradation 
curve (for example, a gradation curve most commonly used for 
a type of subject) (Step S14) . 

10 Next, processes similar to steps Sll through S14 are 

performed with respect to the original image P2 . That is, in 
the case that the image P2 is a processed image, image processing 
conditions therefor are specified or estimated (Step S15) . 

Thereafter, the images PI and P2 are positionally aligned 

15 (Step S16) . Pa\ inter image calculation formula is set that 
enables cancellation of the effects of image processes which 
have been administered or assumed to have been administered on 
the images PI and P2, and performance of an inter image 
calculation simultaneously (Step S17) . The inter image 

20 calculation formula is set based on data related to the image 
processing conditions, or on data related to typical image 
processing conditions. Finally, inter image calculation is 
performed according to the set formula, to obtain an image in 
a state which is as close as possible to that of a difference 

25 image which would be obtained if the images PI and P2, prior 
to image processes being administered thereto, were employed 
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(Step S18) • 

The fourth, fifth and sixth embodiments described above 
are equipped with the positional alignment means 120 for 
aligning the positions of the two images so that structural 
5 components of the single subject substantially match. 
Therefore, artifacts caused by positional misalignment due to 
changes in the posture of a subject, a difference in an imaging 
apparatus and the like can be reduced in the difference image 
obtained by the inter image calculation means 14 0. Accordingly, 

10 a difference image can be obtained which is more suitable for 
observation. Note that the positional alignment means 120 is 
not strictly necessary in the image processing apparatus 2. 
There are cases in which the two images which are the objects 
of inter image calculation are in a state such that 

15 substantially no positional misalignment exists therebetween. 
In these cases, a difference image suitable for effective 
observation can be obtained without performing positional 
alignment . 

Note that the process confirmation data Z may be provided 
20 separately from the image processing condition data C, as in 
the above embodiments. Alternatively, the image processing 
condition data C may also serve as the process confirmation data 
Z. A value of, for example, 0, for a parameter which specifies 
image processing conditions may represent that the image is an 
25 unprocessed image. 

Regarding the sixth embodiment, the process confirmation 
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data Z may be provided for different types of image processes. 
In this case^ a judgment is made regarding whether image 
processes have been administered for each type of image process . 
The inter image calculation formula may be set, based on the 
5 result of the judgment. In addition, a judgment may be made 
regarding whether image processing condition data C are 
attached for each type of image process, for an image which has 
been judged to be a processed image. In the case that the image 
processing condition data C are attached, the formula is set 
10 based on the image processing condition data C. In the case 
that the image processing condition data C are not attached, 
the formula is set based on typical image processing conditions 
for the image process. 
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